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Abstract 

We have shortly reviewed the occurrence of the post-synaptic potentials between neurons, 
the relation between EEG and neuron dynamics, as well as methods of signal analysis. We 
supposed a simple stochastic model representing electrical activity of neuronal systems. The 
model is constructed using the Monte Carlo simulation technique. The results yielded EEG- 



*Address correspondence to Dr. Ekrem Aydiner, Department of Physics, Faculty of Arts and Sciences, 
University of Cukurova, Adana, Turkey. E-mail: ekol@cu.edu.tr 



1 



like signals with their phase portraits in three-dimensional space. The Lyapunov exponent 
was positive, indicating a chaotic behavior. The correlation dimension of the EEG-like signals 
was found to be 0.92, which was smaller than those reported by others. It was concluded 
that this neuron model may provide valuable clues about the dynamic behavior of neural 
systems. 
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1 Introduction 

It is well known that there are about one hundred billions of neurons in the human brain 
each interacting with about tens of thousands of other neurons via synapses. The complex 
processes such as learning, remembering, and thinking are based on neurons exhibiting 
complex interactions. Although the neurons in brain seem to be relatively simple structures, 
their dynamics with consequent integrative functions could not be understood clearly. 

The studies in neurosciences are concentrated in two categories. Studies in the first 
category dealt with modelling of single-neuron dynamics, which are captured with biologi- 
cally inspired neuron model, such as those from |17|] and Fitzhugh-Nagumo equations (0, 
|25[). However, formal neurons, used in artificial neural networks like the [24] or the graded 



response neurons |L4j have only trivial, i.e., convergent dynamics as single elements. Re- 
searchers in the second category are interested in neuronal ensembles. Their purpose is to 
study the modelling of brain-like functions, and to account for collective or clustering ac- 



tions in brain [[28|, [18], II], [1^, ^1, I5| . However, chaotic neuron models based on biological 
motivation were also studied [Q, [J. 

Information processing in brain results from the spread and interaction of electrical and 
chemical signals within and among neurons. This involves nonlinear mechanisms that span a 
wide range of spatial and temporal scales and are constrained to operate within the intricate 



anatomy of neurons and their interconnections ||. The mathematical equations describing 
the brain mechanisms generally do not have analytical solutions, and are not a reliable guide 
to understand the mechanism of the neuron dynamics underlying the brain functions. In 
order to explain neuron dynamics, models constructed to explain the brain functions have to 



exhibit the nonlinear properties of the brain p2| . For this reason, the generally used linear 
approaches are severely limited. Therefore, using simulation techniques would be important 
in this field Jl6| . 

On the other hand, it is generally accepted that there is a relationship between EEG 
signals and neuronal activity. Analysis of the EEG records enables us to obtain some infor- 
mation about the existence of chaotic attractors, different responses to different stimulations, 
epileptic seizures etc [^7], |23], [[], |20|, ^j, [TIJ. In the following Section, we reviewed the cycle 
of neuronal post-synaptic potentials and relations of neuron dynamics to EEG signals; we 
have suggested a simple neuron model exhibiting the collective behaviors organized similar 
to neurons in human brain. Although our model has no direct biological and chemical basis, 
we believe that its importance lies in the fact that it is based on the nature of stochastic elec- 
trical activity between neurons. Finally in the last section, we analyzed collective dynamics 
of neurons by using Monte Carlo method. 



2 BASIS OF NEURON DYNAMICS 

2.1 Cyclic Post Synaptic Potentials (PSP) 

Below, we will summarize how a single neuron's PSP cycle occurs in five steps [ffl. First, 
a neuronal axon is bistable; it can be either active or passive. In the first state, according 
to the result of the summation performed in the soma it propagates a signal - a spike, or 
an action potential (AP). The shape and the amplitude of the propagated signals are stable 
and replicated at the branching points of the axon. The amplitude of this propagated signal 
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is of the order of tens of millivolts. In the second state, there is no signal travelling in 
the axon, rather there is a resting potential. Secondly, when the travelling signal arrives 
at the end of the axon, it causes a release of neuro-transmitters into the synaptic cleft. 
Thirdly, neuro-transmitters arrive at the membrane of the post-synaptic membrane. On 
the post-synaptic side, these neuro-transmitters bind to the receptors causing the latter to 
open up and allow ionic currents to penetrate into the post-synaptic neuron. The amount of 
penetration of ionic currents per pre-synaptic spike is a parameter, which specifies the efficacy 
of the synapse. Fourthly, PSP, contrary to the action potential, propagates in a declining 
manner towards the soma, where the inputs from all of the pre-synaptic neurons connected 
to the post-synaptic neuron are integrated. Fifthly, if the sum of the PSPs arriving within 
a short period exceeds a certain threshold, the level at which the post-synaptic membrane 
becomes unstable against depolarizing ionic current flows, the probability for the emission of 
a spike becomes significant. This threshold is approximately ten millivolts. A large number 
of inputs are required to produce an action potential (spike). 

The cyclic-time of a biological neuron in the cerebral cortex, i.e., the time interval from 
the start of a spike in the pre-synaptic neuron to the occurrence of that spike in the post- 
synaptic neuron is about 1-2 milliseconds. This is the duration for travelling of the spike 
to the pre-synaptic axon till the neurotransmitter crosses the synaptic gap. Following the 
dramatic event of the emission of a spike, the neuron needs time to recover. There is a 
period of 1-2 milliseconds in which the neuron cannot fire a second action potential, no 
matter how large the depolarizing potential might be. This period is called the absolute 
refractory period, determining the maximal discharge rate of a neuron at about 500-1000 
Hz. Such high frequencies can occur in sensory neurons, since the stimulus is externally 
determined and can be arbitrarily strong. In neurons of the cerebral cortex, the neuronal 
firing rates are rather low, such as 150 Hz; it may even be as low as 30-40 Hz J|. 
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2.2 Relation Between Neuron Dynamics and EEG Signals 

During physiological processes, thousands of neurons communicating with each other pro- 
duce an overall electrical activity in the brain, based upon the postsynaptic neuronal activi- 
ties. However, it is impossible to observe the electrical activities of a single neuron in EEG, 
reflecting the overall activity of the brain. That is, EEG signals do not give any information 
directly relating to activity of single cerebral neurons. It is also assumed that the recorded 
EEG signals represent the postsynaptic neurological activities as a function of time, corre- 
sponding to a time series. Hence, the analysis of time series of EEG signals plays a crucial 
role in understanding the collective dynamics of neurons. 

2.3 Analysis of EEG signals 

It can be assumed that the system of interest, i.e., an EEG signal, can be described by N 
variables, where N is a large number, so that at any instant of time there is a point X (t) = 

{Xi(t), Xzit), , Xjv(t)} in an N-dimensional phase space that completely characterizes 

the system. Trajectory of these points in the phase space make-up an attractor. For chaotic 
motion this attractor is often an object that can be described by a fractal dimension. Such 
attractors are called strange attractors. 

Time series captured from the EEG signals may seem to have one-dimensional informa- 
tion but in fact they may have more dimensional information. Reconstructing this kind of 
series in the phase space will show the details of the one- dimensional information of these 
series. Therefore, the proposed method is the construction of a strange attractor, and the 
evaluation of the correlation dimension of this attractor. 

For sufficiently long times r, one uses the embedding theorem of Takens |2?5| to construct 
the sequence of the displaced time series {( (t) , £ (t + r) , £ (t + (m — 1) r)}. This set of 
variables has been shown to possess the same amount of information as the N-dimensional 
phase space, provided that m > 2d + 1, where d is the dimension of the attractor for the 
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original N-variable system. The condition on the embedding dimension m is often overly 
restrictive and the reconstructed attractor usually does not require m to be so large 

For constructing the phase portrait of the EGG signals on the phase space, generally 
choosing m=3 is enough. Hence, one can obtain three-dimensional construction of EEG 
signals as {( (t) , ( (t + r) , ( (t + 2r)}. It is expected that this method produces a strange 
attractor corresponding to the EEG signals, and the correlation dimension of this attractor 
can be evaluated. 

A more efficient approach to calculate the correlation dimension, D2, is introduced by 
Grassberger and Procaccia [|TI|. This approach is based on the behavior of a so-called 
correlation sum (or correlation integral). D 2 has been widely used to characterize chaotic 
attractors. 

To define the correlation dimension, we first let a trajectory (on an attractor) evolve for 
a long time, and collect as data the values of N trajectory points. Then for each point i on 
the trajectory, we ask for the relative number of trajectory points lying within the distance 
r of the point i, excluding the point i itself. Call this number iVj(r). Next, we define Pi(r) to 
be the relative number of points within the distance r of the i th point: pi (r) = iVj/ (N — 1). 
Finally, we compute the correlation sum C(r) [15, | 



1 N 



N 

i=l 



where, 

N 



^W = A73T E ©(r-l^-^-l) (2) 



Pi itself can be written in more formal terms by introducing the Heaviside step function 
6 M: 
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Note that C(r) is defined such that C(r) = 1 if all the data points fall within the distance 
r of each other. If r is smaller than the smallest distance between trajectory points, then 
Pi = for all i , and C{r) = 0. 

The correlation dimension D2 is defined to be the number that satisfies 



C(r) 



lim r D2 



(3) 



After taking logarithms (El) gives 



Do = lim 



log C(r) 



(4) 



+0 log r 

If two nearby trajectory on a chaotic attractor start off with a separation of do at a 
time t — 0, then the trajectories diverge so that their separation at time t can be given as, 
d (t) = d exp (At) or for a discrete time scale as, 



d n = d exp (An) 



(5) 



where A is a measure of the divergence of nearby trajectories. If A is positive, two trajectories 
diverge and thus, the behavior of the trajectories is chaotic. 



3 DEFINITION OF OUR MODEL 

In this study, a simple stochastic neuron model has been developed. The model has neither 
a biological nor a chemical motivation at all. Considering this statement, we can say that 
the model does not encounter a biological neuron system such as that in a brain. Our 
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model can be briefly defined as follows: i) The model consists of N pieces of neuron-like 
(NL) elements; ii) Each NL element is randomly connected with other NL elements, and the 
connection numbers are not equal and are assumed to be in the interval y/N to N/2 . In 
other words, the connection numbers are generated randomly in this interval; iii) a threshold 
potential is defined for each NL element, and when the amount of the accumulated signal 
on a NL element is above the threshold for a single spike. After propagating the spike, the 
NL element integrates the signals from the other NL elements until they reach the lateral 
spike propagation criteria for a second spike and so on. The time interval between the 
two propagations is random; iv) spike propagation from the NL element complies with the 
PSP cycle in principle as mentioned above. However, since our model has no biological 
and chemical motivation, the intracellular chemical cyclic mechanisms necessary for the 
occurrence of PSP; v) we will define PSP cycle of each NL element as PSP-like cycle; vi) we 
can state that the PSP cycle in biological neurons does not only depend on the intracellular 
processes but also on the quality and quantity of the inputs integrated from other neurons. 
Therefore, it is not possible to predict the propagation of a spike from the PSP cycle of a 
neuron. In other words, it is assumed that each neuron realizes its PSP cycle stochastically. 
Hence, the information necessary to understand the dynamics of an ensemble of neurons is 
the time evolution of the propagation of spikes in the system rather than the mechanisms 
underlying the neurons dynamics. With the consideration of this idea, in our NL system, 
to understand the dynamics we have just focused on the stochastic behaviors of the NL 
elements; vii) we have analyzed the dynamics of neurons within discrete time scales. In 
advance, at each discrete value of t, only the NL elements that comply with the PSP-like 
cycle participates to the propagation of spikes; viii) at each discrete value of t, the number of 
NL elements propagating spikes is assumed to be the scale of the integrated signals quantity 
that this NL system generates. Therefore, we assumed -as the amount of the integrated 
signals- that belong to the whole system to be as the amount of integrated signals that were 
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generated by the NL elements within the system; ix) it is also assumed that the amount of 
the generated signals comply with the EEG signals belonging to the system under study. 

4 MONTE CARLO SIMULATION AND RESULTS 

We have used 1000 NL elements to obtain integrated signals for Monte Carlo (MC) sim- 
ulation. The simulation is based on our model mentioned above. The results exhibited 
EEG-like signals (see Fig. |l|). As seen in Fig. |l], these signals are not periodic. Lyapunov 
exponents A for these signals were found to be greater than zero, indicating that signals from 
NL elements exhibit a chaotic behavior. 

Fig. H and Fig. || illustrates the phase portraits of the integrated signals in the phase 
space. To construct phase space, we have used three dimensions, chosen as x(t), x{t + r), 
and x(t + 2r), with r = 1. These phase portraits are similar to the EEG phase portraits of 
experimental data from others [^, |T(J . 

A correlation dimension, known as fractal dimension in the scientific literature, is a 
measure of chaotic behavior of the attractor. The correlation dimension D 2 is given by @ 
Therefore, the slope of the curve (log C(r) against logr) gives D 2 . The curve exhibits two 
different regimes as seen in Figures ^ and [5], |6|. In the first regime, the slope of the curve is 
0.37, in the second regime, the slope of the curve is 0.92, i.e., corresponding D 2 values are 
0.37 and 0.92, respectively. 

5 CONCLUSION AND DISCUSSION 

In the present work, we have constructed a simple neuron model. If the model was solved 
using the well known MC simulation technique, the results yielded EEG-like signals. The 
Lyapunov exponent was found to be positive, and hence these EEG-like signals had chaotic 
behaviors. The obtained EEG signals were put on a three dimensional phase space, which 
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gave us attractors. However, these chaotic attractors constructed in phase space could not 
be clearly seen, contrary to the attractors obtained from the solution of the differential 
equations such as Lorentz type. The reason may be a large number of attractors screen 
each other. The attractors were similar to EEG normally recorded from the human scalp. 
The very large number of attractors suggests that the system would have many stable states 
changing with time. We have also evaluated the correlation dimension, D 2 , corresponding 
to the attractors (see above). Our data indicate two regimes, for them D 2 values were 
found to be 0.37 and 0.92, respectively. The regime with D 2 = 0.37 corresponds to a very 
narrow time interval at small times; the regime with D 2 = 0.92 seems to correspond to 
a rather large time interval. Thus one can assume that for the derived EEG-like signals 
D 2 = 0.92. However, this value is inconsistent with others (see p0[). Accordingly, D 2 values 
were reported to be 4.05 ± 0.50 and 2.05 ± 0.09 in deep sleep and epilepsy, respectively J5|. 
Apparently, the model is open for further evaluations to understand the stochastic brain 
dynamics. Different psycho-physiological states in different subjects may be the reason for 
the contradictory results mentioned above. We have concluded that our tentative model 
constructed to simulate the chaotic brain activity as seen in EEG may be useful in analyzing 
the system dynamics of thousands of cerebral neurons interacting with each other. 



Figure captions 

Figure l:Typical episodes of electrical activity between NL elements similar to elec- 
trical activity of human brain as recorded from EEG. 

Figure 2:Attractor of integrated signals at the phase space. This portrait is the two- 
dimensional projection of the three-dimensional construction : Demonstration of the 
plotted integrated signals 
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Figure 3:Attractor of integrated signals at the phase space. This portrait is the two- 
dimensional projection of the three-dimensional construction : Demonstration of the 
trajectory of these integrated signals. 

Figure 4:Log-Log plot of C(r) versus r gives the correlation dimension D 2 . 

Figure 5: Slopes of log(C(r)) versus log(r) give the correlation dimensions correspond- 
ing to the first regime. 

Figure 6: Slopes of log(C(r)) versus log(r) give the correlation dimensions correspond- 
ing to the second regime . 
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Fig. 1: Typical episodes of electrical activity between NL elements similar to electrical 
activity of human brain as recorded from EEG 
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Fig. 2: Attractor of integrated signals at the phase space. This portrait is the two- di- 
mensional projection of the three-dimensional construction : Demonstration of the plotted 
integrated signals 
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Fig. 3: Attractor of integrated signals at the phase space. This portrait is the two- dimen- 
sional projection of the three-dimensional construction : Demonstration of the trajectory of 
these integrated signals 
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Fig. 4: Log-Log plot of C(r) versus r gives the correlation dimension D 2 
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Fig. 6: Slopes of log(C(r)) versus log(r) give the correlation dimensions corresponding to 
the second regime 



20 



